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(54) Timing in a data communications network 

(57) A data communication network comprises a 
local clock (22) within a node (2) of the network which 
may be synchronized and syntonized by any node in the 
network. Each node contains a time packet detector (6) 
that detects and recognizes timing data packets and 
produces a recognition signal. Each node has a time 
server (10) that includes the local clock (22). The time 
server records the time of the recognition signal. The 
recorded time is used for correcting the local clocks of 
the various nodes (2) in the network. A transfer device 
such as a gateway, a bridge or a router may include a 
time server and a time packet detector to correct for the 
transit time of a time packet through such transfer 
device. The time packet detector (6) is connected at the 
point of final encoding for transmission or recovery of 
the clock and data. 
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Description 

This invention relates to a data communication net- 
work and to a network transfer device for use in, for 
example, loosely coupled distributed systems for serial 5 
communication and a number of nodes. Each node con- 
tains an event recognizer and often a local real-time 
clock. 

Many measurement and control applications 
require precise time control of events at several distrib- 1 
uted locations (nodes) in the system. For example, the 
measurement and control of large scale systems such 
as power sub-stations, airframe test stations, and large 
industrial process facilities involve numerous measure- 
ments at critical points of the system which are used to i 
control the system. Successful operation of these sys- 
tems depends on accurately knowing the times at which 
each measurement was taken and on applying controls 
at known times. 

There are two aspects in providing accurate time in 
a distributed system in which each node contains a local 
clock. The first is syntonization, that is ensuring the local 
clocks at each node are running at the same rate. The 
second is synchronization, that is ensuring the local 
clocks report the same value of time at a given instant 
The causes for inaccuracy and degradation in synchro- 
nization are the failure to maintain syntonization and 
inaccuracies in the setting or resetting of the local times 
values of the clocks. The local clocks lose syntonization 
because there are differences and drifts in the funda- 
mental frequency of the oscillators which drive the 
clocks. 

In systems requiring synchronization and syntoni- 
zation, each local clock recognizes the local time of cer- 
tain events and the nodes exchange messages to 
report these times. A preferred communication protocol 
between the nodes is a packet based serial protocol, 
such as Ethernet, token rings such as IEEE 802.5 or 
LonTalk (TM Echelon). In each node, the protocol is 
implemented by a protocol stack and the operating sys- 
tem of the node. The accuracy to which the clocks can 
be synchronized by exchanging messages currently is 
limited by the time jitter introduced by the protocol stack 
and operating system of each node. An additional prob- 
lem is the latency or propagation delay of a message 
between nodes. In addition to the local protocol stacks 
and operating systems, jitter and delay can be intro- 
duced by other network elements such as gateways, 
bridges, and routers, or the physical communication 
medium. 

One method to manage time jitter and latency 
between the nodes is to use dedicated, calibrated trig- 
ger lines between the various nodes to synchronize the 
clocks, measurements, or the application of control. 
Although the dedicated calibrated trigger lines can be 
very accurate, systems quickly become unmanageable 
and expensive as the number of nodes increases. Alter- 
natively, the desired events may be controlled by issuing 
commands to the nodes from a central controller over a 



control bus, such as IEEE488, or serial protocols, such 
as Ethernet. Using a standard protocol improves the 
manageability of the system but at the expense of time 
accuracy. 

Another method, as taught by Kopetz in U.S. 
4,866,606, is to add a dedicated synchronization unit 
with a dedicated time output within each node. Each 
synchronization unit is connected to the local clock. 
Each local clock communicates with every node in the 
o distributed network via the communication unit of the 
node to supply a global synchronized time signal. A 
message containing the local time of the sender is 
broadcast on the network by the synchronization unit. 
By observing these messages, the receiving node cal- 
f5 culates a correction factor to be applied to the local 
clock. This system is illustrated in Figure 1 . However, as 
shown in Figure 1, this technique may remove the 
effects of the operating system but does not remove the 
jitter and latency of the protocol stack of the communi- 
20 cation system. Implementing the synchronization unit in 
a microprocessor may introduce jitter of its own due to 
operating system or interrupt behavior of the microproc- 
essor. This system also introduces an unknown latency 
within the synchronization unit itself. As described by 
25 Kopetz, the synchronization unit must process all 
received messages which makes the jitter problem even 
harder to manage. 

Another method, as disclosed by Hosgood in UK 
2.254.455A, adds a dedicated "time bus". As shown in 
30 Figure 2, each node contains a time generator, a time 
bus, and two snapshot registers. The local time of day is 
continuously output on the time bus. This method may 
remove operating system jitter and delay but does not 
solve the protocol stack jitter and delay problem. 
35 Although the local time at which the sending node sub- 
mits a message to the communication module of the 
sending node is known, the receiving nodes do not 
know when a message was actually transmitted 
because the communications path between the node 
40 and the timing bus may have different propagation 
delays and the jitter in the protocol stacks of the partici- 
pating nodes. Like Kopetz, the synchronous unit proc- 
esses all received messages which increases the 
difficulty in managing the jitter problem. 
45 The present invention seeks to provide improved 
data communication. 

According to an aspect of the present invention, 
there is provided a data communication network as 
specified in claim 1. 
50 According to another aspect of the present inven- 
tion, there is provided a network transfer device as 
specified in claim 10. 

The preferred embodiments can provide a system 
in which each node in a distributed system maintained 
55 syntonization and synchronization of its local clock in an 
efficient and economical manner that minimized the 
temporal jitter and latency in the communication sys- 
tem. It is also possible to syntonize and synchronize 
throughout the overall system. 
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The invention can provide a method for compensat- 
ing for the time delay and jitter of messages transmitted 
between the nodes by using the event recognizer. 

The preferred embodiment provides a method for 
syntonizing and synchronizing the local clocks in a 
loosely distributed network using messages carried by 
the communication media. The accuracy is improved by 
eliminating operating system and protocol stack delays 
using a "time packet detector". Each node contains a 
time packet detector (TPD) which recognizes signatures 
of specially designated timing packets in a jitter-free 
fashion. Although a node may receive a variety of mes- 
sage packets such as data, control, etc., the TPD solely 
detects the passage of the timing packets. The TPD 
observes the packet data stream as close to the com- 
munication media as possible to minimize delay and jit- 
ter that results from the local protocol stack and 
operation system. When a timing packet is detected by 
the TPD, the TPD generates a trigger signal, which may 
be used to capture the time from the local clock. The 
captured time is the local time at which the timing 
packet was received or transmitted by the node. 

Timing packets are treated as events that are time 
stamped with the current local time at each node and 
these timestamps are then reported to the other nodes. 
These timestamps form the basis for the correction fac- 
tors applied to each local clock. These factors may 
include corrections for latency between nodes. The 
remaining jitter is due only to the communication 
medium itself and the communication access mecha- 
nism between the time recording point and the commu- 
nication medium. 

In operation, a first node sends a first timing packet 
that is recognized and detected by its TPD. This TPD 
generates a transmitting timestamp that reflects the 
local time of transmission, as measured by the transmit- 
ting clock. The f irst timing packet may contain an identi- 
fier for unique identification. The transmission time and 
identifier of the first timing packet are subsequently 
transmitted by the transmitting node in a first synchroni- 
zation message. 

A second node receives the first timing packet and 
the first synchronization message from the first node. 
The TPD of the receiving node detects the arrival of the 
first timing packet and generates a reception timestamp 
that reflects the local time of reception, as measured by 
the receiving clock. The receiving node next receives 
the first synchronization message and compares the 
transmitting timestamp with the reception timestamp. 

From a sequence of these packets and messages, 
the apparent difference and drift between the first and 
the second clocks can be computed and used with a 
suitable algorithm to synchronize and syntonize the 
clocks. The latency of the transmission of the timing 
packet may be measured by repeating the above 
sequence bidirectional ly. Synchronization accuracy is 
improved by taking account of this latency measure- 
ment. 



An embodiment* of the present invention is 
described below, by way of example only, with reference 
to the accompanying drawings, in which: 

5 Figure 1 illustrates a distributed system having a 

synchronization unit (prior art). 

Figure 2 illustrates a distributed system having a 

dedicated timing bus (prior art). 

Figure 3 illustrates a network having distributed 
10 synchronization and syntonization of the clocks. 

Figure 4 illustrates a functional block diagram for 

node 2 shown in Figure 3. 

Figure 5 shows a functional block diagram for the 
LMA shown in Figure 4. 
15 Figure 6 shows a functional block diagram for the 
TSB shown in Figure 4. 

Figure 7 shows a functional block diagram for the 
TPD shown in Figure 4. 

Figure 8 illustrates a typical timing diagram of the 

20 operation of the TPD. 

Figure 9 illustrates using the time packet detector 
as an event trigger mechanism. 
Figure 10 illustrates the use of the TPD for measur- 
ing propagation time 

25 Figure 1 1 illustrates the use of the TPD in adjusting 
the local clocks 

Figures 12A and 12B illustrate the use of TPDs to 
overcome jitter and delay in a network. 

30 Any node in a loosely distributed network can initi- 
ate a clock synchronization or syntonization process. 
Each of the nodes contains a time packet detector 
(TPD), a time service block (TSB), and a local media 
access block (LMA). The TPD and TSB, in concert, rec- 

35 ognize the local time of transmission or receipt of timing 
packets as opposed to the time of scheduling or 
acknowledgment of the timing packet. The TPD detects 
timing packets that enter or leave the nodes. Timing 
packets are a specific packet type designated within the 

40 class of messages used in the communication protocol. 
The detected timing packets can be used by a receiving 
node for synchronization or event execution. 

When a node initiates synchronization, it transmits 
a first timing packet followed by a synchronization mes- 

45 sage that contains the local transmittal time of the first 
timing packet. The receiving node (the node to be syn- 
chronized) compares the local transmittal time con- 
tained in the synchronization message with its local 
receipt time for the first timing packet. A sequence of 

so such results may be used to synchronize or syntonize 
the clocks in the distributed network. 

Figure 3 illustrates a network of nodes where timing 
of events is important. A first node 2 is connected to a 
second node 2* through a communication medium 4. An 

55 optional third node 2" is connected to the communica- 
tion medium 4. Each node can both initiate and respond 
to timing packets and synchronization messages in the 
network. Although the nodes need not be identical, 
each node contains a time packet detector (TPD). Each 



3 



BNSDOCID: <EP 0722233 A2_1_> 



5 



EP 0 722 233 A2 



6 



TPD operates identically on inbound and outbound tim- 
ing packets. 

Figure 4 illustrates a lunctional block diagram for 
node 2 shown in Figure 3. A time packet detector (TPD) 
6 is connected to a local media access block (LMA) 8 
and a time service block (TSB) 10. The LMA 8 is con- 
nected to the TSB 10 and the communication medium 
4. The TSB 10 and the LMA 8 are each connected to a 
basic node function block 12. The basic node function 
block 12 represents an application function that makes 
use of the timing service provided herein. 

Figure 5 illustrates a functional block diagram for 
the local media access block (LMA) 8 shown in Figure 4. 
A transceiver 14 is connected to the communication 
medium 4, a bit-clock and data recovery block 16, and a 
data encoding block 1 8. The bit-clock and data recovery 
block 16 is connected to the transceiver 14, a protocol 
stack 20, and the TPD 6. The data encoding block 18 is 
further connected to the protocol stack 20 and the trans- 
ceiver 14. The TPD 6 is connected to the data encoding 
block 18. The protocol stack 20 is connected to the TSB 
10 and the basic node function block 12. The bit-clock 
and data recovery block 16 and the protocol stack 20 
are further connected to the TPD 6. 

The transceiver 14 provides physical access to the 
communication media 4. The bit-clock and data recov- 
ery block 16 receives raw signals from the transceiver 
14 and recovers a bit-clock signal and a data bit stream 
which is synchronous with an incoming data bit stream. 
The jitter of this recovery process will typically be the 
dominant remaining source of jitter in the system. 

The data encoding block 18 receives outbound 
packets from the protocol stack 20 and transforms these 
packets according to a selected protocol specification. 
The transformed packet is received by the transceiver 
14. The TPD 6 monitors the outbound packets and the 
recovered inbound packets. 

Figure 6 illustrates a functional block diagram for 
the time service block (TSB) shown in Figure 4. A local 
clock 22 is connected to a time control circuit 24, TSB 
memory 26, and the TPD 6. The TSB memory 26 is fur- 
ther connected to the time control circuit 24 and an 
optional processor 28. The time control circuit 24 con- 
nects to the TPD 6 and the optional processor 28. The 
time control circuit 24 connects to the basic node func- 
tion 1 2 and the LMA 8 either directly or optionally via the 
optional processor 28. 

The local clock 22 provides a representation of time 
and can be synchronized and syntonized. The local 
clock 22 contains circuitry that delivers the reading of 
the clock to the TSB memory 26 upon receipt of a suit- 
able event signal from the TPD 6. The local clock 22 
receives correction data and signals generated by the 
time control circuit 24, optionally in conjunction with the 
optional processor 28, for the synchronization and syn- 
tonization functionality. The correction data and signals 
are used to synchronize or syntonize the clock and the 
event signals are used for recording the TPD event time 
as measured by the local clock. 
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The TSB memory 26 stores captured values of the 
time received from the local clock 22. These values may 
be used by the time control circuit 24 or the optional 
processor 28 for computing the correction factors nec- 
5 essary for the clock adjustments. The time control cir- 
cuit 24 also receives, via the LMA 8, the various timing 
packets and messages used in computing the various 
correction factors and for the overall control of the entire 
TSB 10. The time control circuit 24 may deliver optional 
10 pattern matching specifications, such as an identifier, to 
the TPD 6 for additional configuration and detection. 
The identifier may be used by the time control circuit 24 
to associate the local detection time with the synchroni- 
zation message received from the LMA 8. 
is The TSB 10 functionality may be supplemented to 
support the basic node functionality. Additional function- 
ality may include time, additional memory for event 
detection, and generating event signals pertinent to the 
basic node functionality. 
20 Figure 7 illustrates a functional block diagram of the 
time packet detector (TPD) 6 shown in Figure 4. A TPD 
control circuit 30 is connected to an optional memory 
32, pattern memory 34, a pattern matching circuit 36, a 
pattern address generator 38, and a start-of-frame 
25 detector 40. The TPD control circuit 30 connects to the 
TSB 10. The pattern matching circuit 36 connects to the 
optional memory 32, pattern memory 34, and the LMA 
8. The pattern address generator 38 further connects to 
pattern memory 34 and the LMA 8. The start-of-frame 
30 detector 40 further connects to the LMA 8. 

The start-of-frame detector 40 monitors the incom- 
ing data stream and signals the TPD control circuit 30 
when a start-of-frame condition is detected. In serial 
communication protocols, the data packet contains a 
35 pattern, called the training bit pattern or preamble, that 
is used by the bit-clock and data recovery block 16 to 
regenerate the data clock and data stream. The end of 
the preamble is marked by a special pattern that is 
detected by the start-of-frame detector 40 and indicates 
40 that the next bit will be the first bit of the packet header. 
The specifications of the training bit pattern and the 
start-of-frame mark are different for each communica- 
tion protocol. The start-of-frame detector 40 may be 
implemented specifically for a given protocol, e.g. Ether- 
45 net, or it may be configurable for the protocol currently in 
use based on configuration data received from the TSB 
10 via the TPD control circuit 30. 

The data clock stream is also received by the pat- 
tern address generator 38 which generates an address 
so to drive the pattern memory 34. The address reflects 
the bit count of the incoming data stream beginning with 
the first bit after the start-of-frame condition is detected. 
The pattern address generator 38 is enabled by the 
TPD control circuit 30 in response to a start-of-frame 
55 detector signal that indicates the start of a new frame. 

The pattern memory 34 contains the bit patterns 
used by the pattern matching circuit 36 for recognizing 
and detecting the presence of the desired timing packet. 
These patterns are used by the pattern matching circuit 
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36 in concert with the corresponding data bit from the 
LMA 8 based on the address received from the pattern 
address generator 38. Typically this stream of pattern 
data will include the bits representing the bit pattern in 
the packet header or the user data and a mask pattern 5 
that indicate which bits are to be checked and which are 
to be ignored. Together these patterns enable the pat- 
tern matching circuit 36 to identify and detect a packet 
uniquely as being a timing packet Typically this identifi- 
cation can be made based on address bits in the packet 
header but the technique works just as well if user data 
bits are included. For example, with the Ethernet proto- 
col a broadcast address could be assigned to the timing 
packet and would appear as a unique address in the 
first six bytes of the packet header. This address would 
be unique in the system and therefore will enable the 
pattern matching circuitry to distinguish timing packets 
from all others. 

The data in the pattern memory 34 is obtained from 
the TSB 10 via the TPD control circuit 30. This data is 
protocol and application dependent. Certain addresses 
may be permanently reserved as timing packets by all 
nodes. In this case, the patterns and optional control 
patterns may be loaded permanently into the pattern 
memory 34. In addition to the pattern data itself, there 
may be additional bit streams stored in the pattern 
memory 34 which aid the TPD control circuit 30. For 
example, a data pattern could be stored that contains a 
bit indicating that the last bit of the pattern that needs to 
be checked to determine a match has been processed. 
Likewise patterns could be stored that specify a pattern 
of bits, for example, the identifier bits, that are to be cap- 
tured and stored in an optional memory 32. The optional 
memory 32, transmits this stored data to the TSB 10 via 
the TPD control circuit 30. 

The pattern matching circuit 36 receives the incom- 
ing data stream from the LMA 8, and the pattern data 
from the pattern memory 34. When enabled, the pattern 
matching circuit 36 does a bit-by-bit check on the 
incoming data stream with respect to the data from the 
pattern memory 34. Any failure to make an appropriate 
match is noted and when the end-of-match condition is 
reached a signal is produced and sent to the TPD con- 
trol circuit 30 for transfer to the TSB 10 indicating 
whether the current packet was a timing packet. The 
time-of-receipt of this signal indicates when the packet 
was detected. This end-of-match condition can be indi- 
cated either by a bit pattern delivered by the pattern 
memory 34 or a control signal from the TPD control cir- 
cuit 30 derived from the pattern address generator 38. 
The timing of this end of match condition is known and 
constant and will depend on the mask pattern defining 
the bits of interest in the packet and will be consistent 
throughout the system for a given application. The pat- 
tern matching circuit 36 may contain optional matching 
and bit handling circuitry for additional control. Note that 
this process is jitter free apart from the picosecond level 
jitter of the individual gates in the pattern matching cir- 
cuitry logic wNch will be orders of magnitude less than 



8 

the remaining jitter from the bit-clock recovery portion of 
the LMA. 

All of the functionality of the TPD 6, TSB 10, and 
part of the LMA 8 may be implemented in a single inte- 
grated circuit. 

Figure 8 is a timing diagram for the TPD. Line A is a 
data stream. Line B is a recovered bit-clock stream. Line 
C is a control bit indicating the start-of-frame. Line D is 
pattern memory address. Line E is a target data stream. 
Line F is a mask stream. Line G indicates the end-of- 
match condition. Line H is a recognition signal. 

This functionality has been described as if the 
incoming data stream were a single bit wide. Some 
newer serial protocols have a serial data stream that is 
several bits wide. The extension of the technique 
described here to such streams is obvious, namely the 
width of the patterns in the pattern memory 34 and of 
the pattern matching circuit 36 is increased to match the 
width of the incoming data stream. 

Figure 9 illustrates a timing diagram when the tim- 
ing packet detector is used as an event trigger genera- 
tor. Each node is connected to the communication 
medium. Node A initiates a timing packet that is 
detected at successively later times along the network 
by the other nodes as indicated in the timing diagram 1 . 
The TPD of each node recognizes and detects the tim- 
ing packet and generates the recognition signal which is 
used for some application purpose, e.g., closing a relay. 
These pulses will be offset in time from each other by 
the respective propagation delays, tf the propagation 
delays are measured, as discussed later, then the 
pulses may be delayed by the TSB of each node by the 
amount shown resulting in simultaneous pulses as 
shown in timing diagram 2. 

Figure 10 shows a timing diagram when the timing 
packet detector is used for measuring the propagation 
delay, or latency, between two nodes. Thus Node A 
sends timing packet "a" which is seen by the TPD at A 
at a local time of 100 ns and at the TPD of B at a local 
time of 80 ns. Next Node B sends timing packet "b" 
which is seen by the TPD at B at a local time of 200 ns 
and at the TPD of A at a local time of 300 ns. It is rea- 
sonable to assume the delay is symmetric since equiva- 
lent delays are encountered by both packets in each 
node and the medium. After the two nodes exchange a 
second set of synchronization messages, each contain- 
ing the respective measured time, each node can com- 
pute that the A to B apparent propagation time is -20 ns 
and the B to A apparent propagation time is 100 ns. The 
average of these is the actual delay, 40 ns. It is also 
apparent that the local clock in Node B lags the clock in 
Node A by 60 ns at the time of the experiment. 

Figure 11 illustrates the timing diagram when the 
timing packet detector is used for adjusting the local 
clocks of two nodes so that they are synchronous and 
syntonous. In this example, Node A is the clock initiating 
synchronization. The times of detection of the various 
packets by the TPDs of each node are noted later. 
Assume for example that the propagation delay 
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between the two nodes has been determined to be 40 
hs as in the description of Figure 10. 

Node A sends timing packet "a1" which is 
detected by TPD A at time ta1 = 0. 

Timing packet "a1 " is detected by TPD B at time 
tb1 =140 ns. 

Node A sends a synchronization message "si" 
containing the information ta1 = 0 

Node B receives "si " and computes an apparent 
time difference B-A of 140 ns. Node B corrects this 
value by the known propagation delay of 40 ns to con- 
clude that the clock at B is ahead of the clock at A by 
100 ns. Node A sends timing packet "a2" that is 
detected by TPD A at time ta2 = 1 

second 

Timing packet "a2" is detected by TPD B at time 
tb2 = 1 S + 240 ns. 

Node A sends a synchronization message "s2" 
containing the information ta2 = 1 s. 

Node B receives "s2" and computes an apparent 
time difference B-A of 240 ns. Node B corrects this 
value by the known propagation delay of 40 ns to con- 
clude that the clock at B is ahead of A by 200 ns. 

Node B resets its local clock back by 200 ns so 
that it is synchronous with the clock at Node A. Node B 
computes that between "a1" and "a2", an interval of 1 
second on the clock of Node A that the clock of Node B 
gained 100 ns. Node B then adjusts the rate of its local 
clock to slow it down by 1 00 ns/second. 

By periodic application of this basic method the 
clocks of two nodes may be kept in agreement. Clearly 
if the fundamental stability of the oscillators driving the 
clocks is adequate, suitable averaging of a series of 
measurements may be made to reduce further the 
effect of jitter. Likewise these basic measurements may 
be made by an ensemble of nodes and a variety of algo- 
rithms, well documented in the literature, applied to pro- 
duce global agreement of the clocks. 

Although the method has been described using 
master-slave algorithm between nodes, the timing pro- 

lOCOl UclM utj tsAienueu 10 a \-iion iuulcu divj^iL ~j ^«%* 

viding each node with full transmitting and receiving 
capability of the timing packets and synchronization 
messages. Thus, each node can perform the computa- 
tions and actions required by the distributed algorithm. 

Figures 12A and 12B illustrate the use of timing 
packet detectors to overcome jitter and delay in a net- 
work. Figure 12A illustrates the TPDs as external to the 
transfer device and Figure 12B illustrates the TPDs 
designed into a transfer device. Two subnets of the com- 
munication network A and B are shown with a transfer 
device providing the communication path between the 
two subnets. Also shown are LMAs and TPDs serving 
each side of the transfer device and communicating with 
the respective communication media. The two TPDs 
and LMAs also interact with a common TSB. 

There are two ways in which the components illus- 
trated in Figures 12A and 12B may be used to achieve 
clock agreement in time critical nodes separated by the 
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transfer device. The first'is for ail of the nodes in both 
subnets, A and B, to agree that the "clock in the TSB 
associated with the transfer device" is the master clock, 
and to synchronize and syntonize the time critical nodes 

5 with this master clock as described earlier. 

A second technique is to have the TPDs and the 
TSB at the transfer device record the time that timing 
packets spend in transit through the transfer device and 
to report this per packet additional delay to the nodes 

10 receiving the timing packet so that they may correct for 
the additional delay. 

In both cases, the communication protocol and 
medium may be different on the A and B sides of the 
transfer device without loss of accuracy since the delay 

is in the detection process of the two TPDs is constant and 
can be computed based on the protocol and the detec- 
tion and recognition pattern. In addition, using the tech- 
niques described earlier, the clock of the transfer device 
may be simultaneously synchronized to a node in a first 

20 subnet while acting as the master clock for nodes in the 
second subnet. 

The disclosures in United States patent application 
no. 08/360,508, from which this application claims prior- 
ity, and in the abstract accompanying this application 

25 are incorporated herein by reference. 

Claims 

1. A data communication network having distributed 
30 time synchronization, the network comprising: 

a first node (2) for generating a first timing 
data packet; 

a second node (2) for receiving the first tim- 
ing data packet, the second node including a local 
35 media access means (8) for observing packets and 
messages and a timing packet detector (6) con- 
nected to the local media access means for detect- 
ing arrivals and departures of the packets, the 
second node operative to produce a corresponding 
40 action when the timing packet detector detects the 
arrival of the first timing data packet; and 

communications means (4) for carrying 
packets and messages between the first node and 
the second node. 

45 

2. A data communication network according to claim 1 
wherein: 

the first node (2) comprises: a first local 
clock (22); a local media access means (8) for 

so observing packets and messages; a timing packet 
detector (6) connected to the local media access 
means for detecting arrivals and departures of 
packets; and a first time server (10) connected to 
the timing packet detector of the first node and the 

55 first local clock for marking a detection time for 
packets and generating a message corresponding 
to detection of a packet, the first time server opera- 
tive to generate a first time synchronization mes- 
sage which contains a departure time for the first 
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timing data packet when the first timing packet 
detector detects the first timing 'data packet depart- 
ing from the local media access means of the first 
node ; and 

the second node (2) comprises: a second 5 
local clock (22); a second time server (10) con- 
nected to the second local clock, the timing packet 
detector of the second node, and the local media 
access means of the second node for marking a 
detection time for packets and generating a mes- w 
sage corresponding to a detection of a packet, the 
second time server operative to mark the arrival of 
the first timing data packet; a comparator (36) con- 
nected to the second time server for receiving the 
first time synchronization message, comparing the 15 
departure time and the arrival time of the first timing 
data packet and producing a first difference signal 
indicating an apparent difference between the first 
and the second local clocks, and error correction 
means (24) connected to the comparator for adjust- 20 
ing the second local clock, the second local clock 
being synchronized according to the first difference 
signal. 

3. A data communication network, having distributed 25 
time synchronization, as defined in claim 2. wherein 
the second node is operative to generate a second 
timing data packet and the second time server is 
operative to generate a second time synchroniza- 
tion message which contains a departure time for 30 
the second timing data packet when the timing 
packet detector of the second node detects the sec- 
ond timing data packet departing from the local 
media access means of the second node; 

the timing packet detector (6) of the first 35 
node (2) is operative to detect the second timing 
data packet arriving at the local media access 
means of the first node; the first node including a 
comparator (36), connectable to the first time 
server and operative to compare the departure time 40 
and the arrival time of the second timing data 
packet and to produce a second difference signal 
indicating an apparent difference between the first 
and second local clocks; 

the first time server (10) being operable to 45 
generate a time propagation message which con- 
tains the second difference signal; 

wherein the comparator of the second node 
is operative to determine a propagation delay 
between the timing packet detectors of the first and so 
the second nodes using the first synchronization 
message and the time propagation message when 
the second time server receives the time propaga- 
tion message. 

55 

4. A data communication network according to claim 3 
wherein the comparator of the second node is oper- 
ative to adjust the first difference signal according to 
the propagation delay. 



5. A data communication network according to claim 4 
wherein the communications means (4) comprises 
a first subnet connected to the first node, a second 
subnet connected to the second node, and a trans- 
fer device (6) connected between the first subnet 
and the second subnet, the transfer device com- 
prising: 

a transfer device clock (22); 

transfer means connected between the first 
and second subnets for transferring packets 
between the first and second subnets; 

a first transfer local media access means (8) 
connected to the first subnet for observing packets 
and messages; 

a first transfer device timing packet detector 
(6) connected to the first local media access means 
for detecting arrivals and departures of packets, 
operative to detect the first timing data packet arriv- 
ing at the first transfer local media access means 
and to produce a first transfer recognition signal; 

a second transfer local media access means 
(8) connected to the second subnet for observing 
packets and messages; 

a second transfer device timing packet 
detector (6) connected to the second transfer local 
media access means for detecting arrivals and 
departures of packets, operative to detect the first 
timing data packet departing from the second trans- 
fer local media access means and to produce a 
second transfer recognition signal; 

a transfer device time server (10) connected 
to the transfer device clock for receiving the first and 
second transfer recognition signals and recording a 
local arrival time for the first timing data packet and 
a local departure time for the first timing data 
packet; and 

computation means (24) connected to the 
transfer device time server for computing a first 
transfer device transit time from the local arrival 
time and the local departure time of the first timing 
data packet and for generating a transit time mes- 
sage containing the first transfer device transit time, 
and wherein the comparator of the second node 
adjusts the first difference signal according to the 
first transfer device transit time. 

6. A data communication network according to claim 5 
wherein: the first transfer device timing packet 
detector (6) is operative to detect the second timing 
data packet arriving at the first transfer local access 
media means; the second transfer device timing 
packet detector (6) detects the second timing data 
packet departing from the second transfer local 
access media means; the transfer device time 
server (10) records a local arrival time and a local 
departure time for the second timing data packet; 
the computation means (24) computes a second 
transfer device transit time from the local arrival 
time and the local departure time for the second 



7 



BNSDOCID: <EP 0722233A2_L> 



13 



EP0 722 233 A2 



14 



timing data packet and generates a second transit 
time message which contains the second transfer 
device transit time; and the comparator (36) of the 
first node adjusts the second difference signal 
according to the second transfer device transit time. 5 

A data communication network according to claim 4 
wherein the communications means (4) comprises 
a first subnet connected to the first node (2), a sec- 
ond subnet connected to the second node (2), and 10 
a transfer device (6) connected between the first 
and the second subnet, the transfer device com- 
prising: 

a transfer device clock (22); 
a transfer means for transferring packets 15 
between the first and second subnets, connected 
between the first and second subnets; 

a first transfer local media access means 
(8)connected to the first subnet for observing pack- 
ets and messages; 20 

a first transfer device timing packet detector 
(6) connected to the first local media access means 
for detecting departures of packets and messages, 
operative to detect the first timing data packet from 
the first node and to produce a first transfer recog- 25 
nition signal; 

a transfer device time server (10) connected 
to the transfer device clock for marking the arrival of 
the first timing data packet and generating packets 
and messages corresponding to the first timing 30 
data packet; 

a comparator (36) connected to the transfer 
device time server for receiving the first time syn- 
chronization message from the first node, compar- 
ing the departure time and the arrival time of the 35 
first timing data packet, and producing a transfer 
difference signal indicating an apparent difference 
between the first local clock (22) and the transfer 
device clock; 

a transfer error correction means (24) con- 40 
nected to the comparator for synchronizing the 
transfer device clock according to the transfer differ- 
ence signal; 

a second transfer local media access means 
(8) connected to the second subnet for observing 45 
packets and messages; and 

a second transfer device timing packet 
detector (6) connected to the second local media 
access means for detecting departures of packets 
and messages, 50 

the second transfer device timing packet 
detector operative to detect the first timing data 
packet departing from the second transfer local 
access means, the transfer device time server 
operative to produce a transfer synchronization 55 
message which contains the departure time of the 
first timing data packet, and the comparator of the 
second node is operative to adjust the second dif- 



ference signal according to the transfer synchroni- 
zation message. 

A data communication network according to claim 4 
wherein the communications means (4) comprises 
a first subnet connected to the first node (2), a sec- 
ond subnet connected to the second node (2), and 
a transfer device (6) connected between the first 
and second subnets, the transfer device compris- 
ing: 

a transfer device clock (22); 
a transfer means connected between the 
first and second subnets for transferring packets 
between the first and second subnets; 

a first transfer local media access means (8) 
connected to the first subnet for observing packets 
and messages; 

a first transfer device timing packet detector 
(6) connected to the first local media access means 
for detecting departures of the packets and mes- 
sages, operative to detect the first transfer timing 
data packet departing from the first transfer local 
access media means and to produce a first transfer 
recognition signal; 

a second transfer local media access means 
(8) connected to the second subnet for observing 
the packets and messages; 

a second transfer device timing packet 
detector (6) connected to the second local media 
access means for detecting departures of the pack- 
ets and messages, operative to detect a second 
transfer timing data packet departing from the sec- 
ond transfer local access means and to produce a 
second transfer recognition signal; 

a transfer device time server (10) connected 
to the transfer device clock for generating packets 
and messages, receiving the f irst and second trans- 
fer recognition signals, and recording a local depar- 
ture time for the first transfer timing data packet and 
a local departure time for the second transfer timing 
data packet; and 

computation means (24) connected to the 
transfer device time server for generating a first 
transfer synchronization message which contains 
the local departure time for the first transfer timing 
data packet and a second transfer synchronization 
message which contains the local departure time 
for the second transfer timing data packet, the com- 
parator of the first node operative to adjust the sec- 
ond difference signal according to the first transfer 
synchronization message and the comparator of 
the second node operative to adjust the first differ- 
ence signal according to the second transfer syn- 
chronization message. 

9. A data communication network according to claim 8 
wherein: the transfer device (6) is operative to 
receive the second timing data packet and the sec- 
ond time synchronization message from the second 
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node and the first timing data packet and the first 
time synchronization message from the first node; 
the computation means (24) is operative to deter- 
mine a first subnet propagation delay between the 
first node and the transfer device and a second sub- 5 
net propagation delay between the second node 
and the transfer device; the comparator of the first 
node adjusts the second difference signal accord- 
ing to the first subnet propagation delay; and the 
comparator of the second node adjusts the first dif- w 
ference signal according to the second subnet 
propagation delay. 

10. A network transfer device for transferring packets 
and messages between a first and a second subnet 
of a network comprising: 

a transfer device clock (22); 

a transfer means for transferring packets 
between the first and the second subnets, connect- 
ing between the first and the second subnets; 

a first transfer local media access means (8) 
for observing the packets and messages, connect- 
ing to the first subnet; 

a first timing packet detector (6), responsive 
to movement of a timing packet at the first transfer 
local media access means to produce a first recog- 
nition signal indicative of the time of said move- 
ment; 

a second transfer local media access means 
(8) for observing the packets and messages, con- 
necting to the second subnet; 

a second timing packet detector (6), respon- 
sive to movement of a timing packet at the second 
transfer local media access means to produce a 
second recognition signal indicative of the time of 
said movement; 

a transfer device time server (10) for record- 
ing movement times for timing data packets accord- 
ing to the first and second recognition signals; and 

computation means (24), connecting to the 
transfer device time server, for generating time 
messages respecting the times of movement of tim- 
ing packets at the first and second transfer local 
media access means. 

11. A network transfer device according to claim 10 
wherein: 

the first timing packet detector (6) is opera- 
tive to detect an arrival of a timing data packet at the 
first transfer local media access means, 

the second timing packet detector (6) is 
operative to detect a departure of the same timing 
data packet from the second transfer local media 
access means; 

the computation means (24) is operative to 
compute a transfer device transmit time for said tim- 
ing data packet; and 

the time message comprises said transfer 
device transit time. 



16 

12. A network transfer device according to claim 11 
wherein the transfer device is operative to receive 
the second timing data packet and the second time 
synchronization message from the second node 
and the first timing data packet and the first time 
synchronization message from the first node, and 
the computation means (24) is operative to deter- 
mine a first subnet propagation delay between the 
first node and the transfer device and a second sub- 
net propagation delay between the second node 
and the transfer device. 

13. A network transfer device according to claim 10 
wherein: 

the first timing packet detector (6) is opera- 
ble to detect a departure of a first timing data packet 
from the first transfer local media access means, 

the second timing packet detector (6) is 
operable to detect a departure of a second timing 
data packet from the second transfer local media 
access means; and 

the time, message generated by the compu- 
tation means (24) comprises a synchronization 
message that includes the departure time of at 
least one of the timing data packets from the corre- 
sponding transfer local media access means. 



EP 0 722 233 A2 



20 



25 



30 



35 



40 



45 



50 



9 



BNSDOCID: <EP 0722233 A2_1_> 



EP 0 722 233 A2 




10 



BNSDOCID: <EP 0722233A2_L> 



EP 0 722 233 A2 



Q 



r 



to 

o 
o 



or 
to 
to 



sr 



■v 



LU Z 
2 UJ 



CO 



S Z 



(Nl 

tr 
</) 
to 



J 



LU 



3 
CL 

O 



A. 
V 



1/ 



A 



V 



5 > 



cr 
to 
to 



A. 
sr 



1/ 



UJ 
2 



3 
CL 
O 



V 



J 



5 

cr 
o 



11 



BNSDOCID: <EP 0722233A2_I_> 



EP 0 722 233 A2 




12 



BNSDOCID: <EP 0722233 A2 J _> 



EP 0 722 233 A2 



co 



- 1 < Kl ~ 

< ^ lu 5 
o Q o S 

j2 < d 



(NJ 



UujO 
(/I Q Z 
< O ZD 
CD Z il 




CJD 



cr 


t 


o 




h- * — 




LLi O 




LU * W 
^ O H- 
1: < l±J 


(OdJ 


I — G_ Q 


f 



13 



BNSDOCID: <EP_ 



_0722233A2_I_> 



EP 0 722 233 A2 



CO 




14 



BNSDOCID: <EP 0722233A2_I_> 



EP 0 722 233 A2 



CM 



GO 




5: 



15 



BNSDOCID: <EP, 



0722233A2J_> 



EP 0 722 233 A2 




16 



BNSDOCID: <EP 0722233A2_L> 



EP 0 722 233 A2 



1 1 1 I i I i 



I 



d q 

d q 
d q 



CM 



O' 



1 



d 

d 
d 



d 



d 



LU 



3 o 
Go fr 

LU LL 

^9 



o < — i 

Q O 
Z _| 
LU ^ O 

clQq: 

LU J— t— 
Q < 2 
— I O 
° LU O 

K cr lu 
° o x 

r- O h- 



< 

a 



o 
o 
—j 
o 

I 



CD 

rib 



LL 

o 
o 



CO 
LU 

a: 
a 
a 
< 







1 

o 


LU 






CD 






cr 


LO 


:z 


< 


< 


o 






o 


LU 


LL 


o 



o 
o 
o 

LU 

cr 



17 



BNSDOCID: <EP 0722233A2_I_> 



EP0 722 233 A2 




CO 



o 
d 



Q 
O 
CD 



CO 



o 




LU 


Q 


NOD 


CL 



O 



O 





CD 






LU 


Q 




ODl 


CL 
1 — 




z 





in 



CD 




< 

-J 

LU 
Q 
« 

X 

o 



m 

CD 



GO 

>- 
< 

1 

LU 
Q 



< 

5 

t: 

Q 
Q 

< 



CM 



BNSDOCID: <EP 0722233 A2_l_> 



18 



EP 0 722 233 A2 



TPD A 



TPD B 



a « 



*b* 



LOCAL TIME 
AT TPD A 



100 



LOCAL TIME 
AT TPD B 



300 



•ID- 



CORRECTED LOCAL 
TIME AT TPD B 




140 



260 



FIG. 10 



19 



EP 0 722 233 A2 



LOCAL TIME 
AT NODE A 



LOCAL TIME 
AT NODE B 



a1 



- - _ 'or 



- - _ sv 



bi 



a2 



•a2* 



b2 



- - _ -s2" 



FIG. 11 



20 



BNSDOCID: <EP 0722233A2_I_> 



EP0 722 233 A2 



CD 



LU 



CD 
Z> 
CO 



r 



Q 



CD 

in 




Q 

CL 



< 
2 



L 



-_l 



LU 
CD 

en 



BNSDOCIO: <EP 0722233A2_I_> 



21 



EP 0 722 233 A2 



CD 




CD 
Z> 



22 



BNSDOCID: <EP 0722233A2_I_> 



(19) 



J 



(12) 



Europdisches Patentamt 
European Patent Office 
Off ice europ^en des brevets (11) EP 0 722 233 A3 

EUROPEAN PATENT APPLICATION 



(88) Date of publication A3: 

26.11.1997 Bulletin 1997/48 

(43) Date of publication A2: 

17.07.1996 Bulletin 1996/29 

(21) Application number: 95309322.6 

(22) Date of filing: 20.12.1995 



(51) Intel. 6 : H04J 3/06, G06F 1/14 



(84) 


Designated Contracting States: 


• Woods, Stanley P. 




DE FR GB 


Santa Clara, CA 95051 (US) 






• Cutler, Leonard S. 


(30) 


Priority: 21.12.1994 US 360508 


Los Altos Hills, CA 94022 (US) 






• Giffard, Robin P. 


(71) 


Applicant: 


Los Altos, CA 94024 (US) 




Hewlett-Packard Company 


• Johnson, James L. 




Palo Alto, California 94304 (US) 


Scotts Valley, CA 95066 (US) 


(72) 


Inventors: 


(74) Representative: 


• 


Eidson, John C. 


Jehan, Robert et al 




Palo Alto, CA 94303 (US) 


Williams, Powell & Associates, 


• 


Dara-Abrams, Joseph A. 


34 Tavistock Street 




LOS AltOS, CA 94024 (US) 


London WC2E 7PB (GB) 
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that detects and recognizes timing data packets and 
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recorded time is used for correcting the local clocks of 
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time server and a time packet detector to correct for the 
transit time of a time packet through such transfer 
device. The time packet detector (6) is connected at the 
point of final encoding for transmission or recovery of 
the clock and data. 
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